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1 Introduction 

i . j I-T - \ — * 

In this paper, we use_the theory of bialgebras.to prove a state space realiza- 
tion theorem for input/output maps of dynamical systems. This approach 
allows jis to consider from a commoirviewporntthe classical results of Fliess 
Fliess^ [3], [4] and more recent results on realizations involving families of 
tree s [XL, [6]. The foljowing definition is fundamental to this approach. If H 
be a bialgebra, we say that p £ II* is differentially produced by the algebra 
72 with the augmentation £ if 

1. there is right H - module .algebra structure on 72; 

2. there exists / £ R satisfying p(h) = • h). 

\ We will characterize those p £ II * which are differentially produced. 

Differentially produced elements of algebras arise naturally when study- 
ing dynamical systems with inputs and outputs. For example, let R denote 
the field of rational functions in the variables. X\ x /v with coefficients 

from the field k, and let 7?i , . . , , Em denote M derivations of 72. The dy- 

namical system 

M 

x{t) = Y, 

/i=l 

x(0) = x° e k n (i) 
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together with an observation function / £ R 


f : — ♦ R (2) 

naturally specifies an input/output map, which is defined by sending the 
input functions 

t -► ui(t) 7 ..., t -> u M (t) 

to the output function 

* - /(*(*))• 

The properties of the input/output map are captured by the formal series 

Z c 

words p. 


where 

Cn — Efx k ’ • ■ E^f(x( 0)), p = fix •• a word. 

This series is often called the generating series, while the data consisting of 
a dynamical system with inputs, together with an observation, are called 
a state space realization of the input/output map. Isadori [11] contains a 
detailed description of these topics, as well as extensive references. 

Let H denotes the free associative algebra in the symbols jE7i , . . . , E\f 
over the field k and let H* denote its topological dual. H* is isomorphic 
to a formal power series algebra in infinitely many variables. The point of 
view of this paper is to consider the formal series p as an element of the 
algebra H* . If p E H* is the formal series associated with an input/output 
map, then it is differentially produced. Conversely, we can ask which formal 
series p E II* have the property that there is a dynamical system and 
an observation function which realizes it as above; that is, which p are 
differentially produced? We will see that both these questions are simply 
answered if we exploit the bialgebra structure of H . 

Important work in this area has been done by Fleiss [3] and [4], Hermann 
and Krener [10], and Sussman [16]. Fleiss was the first to focus on the 
algebraic and combinatorial aspects of the problem, making important use of 
shuffle algebras in his study of realization theory. His work was simplified by 
Reutenauer [15]. In this paper, we generalize and simplify the work of Fleiss 
and Reutenauer, extending the context to general bialgebras. This allows 
us to treat combinatorial examples of differential representations which have 
arisen in the symbolic computation of solutions of differential equations [8] 
and [7]. 
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To state the theorem we prove in Section 2, we need some definitions. 
Let k denote a field of characteristic 0. If V is a vector space over fc, denote 
by V* the set of all linear maps V —> k. The vector space V* with the finite 
topology is a complete topological vector space (see [12] for details). 

By an algebra over k we mean an associative algebra with identity. The 
algebra structure of A can be specified by the maps A A — ► A which 
maps a® 6 £ A A to ab E /l, and k — * A which maps 1 E k to 1 E A. The 
facts that multiplication is associative and that 1 6 A is a two-sided unit 
for multiplication can be expressed in terms of the commutativity of certain 
diagrams. An augmentation for the algebra A is an algebra homomorphism 
A — ► k. 

In a dual manner we define a coalgebra . A coalgebra is a vector space 
C over k y equipped with maps A : C — ► C ®jt C and e : C — ► k which give 
a coassociative comultiplication and a counit (that is, the diagrams which 
are dual to those in the definition of an algebra commute). If c £ C we 
will sometimes write the element A(c) E C Qk C as ® C( 2 ), using 

notation introduced by Sweedler in [17]. If C is a coalgebra, then C* is an 
algebra. Note that e : C — ► k is the multiplicative identity for the algebra 

C\ 

We define a bialgebra to be a vector space H equipped with an alge- 
bra and a coalgebra structure, so that the maps which define the coalgebra 
structure are algebra homomorphisms, or equivalently, the maps which de- 
fine the algebra structure are coalgebra homomorphisms. In particular, the 
coalgebra counit e is an augmentation for the algebra H . If 77 is a bialgebra, 
its primitive elements are defined by 

P{H) = {he II I A(h) = 1 0 h + h ® 1 }. 

It can be shown that P(II) is a Lie algebra with respect to the operation 
[x,y] — xy — yx . It ha 5 been shown [14] that if the characteristic of k 
is 0, and II is generated as an algebra by P{H) (in which case we say that 
H is primitively generated ), then H = U(P(H)) y where U(L) denotes the 
universal enveloping algebra of the Lie algebra L. The Poincare-Birkhoff- 
Witt Theorem (see [13]) states that if e\, e 2 , . . . is an ordered basis for X, 
then 

{ e“' 1 • ■ • e“'* |n < ■ ■ ■< i k and 0 < a lr } 

is a basis for U(L). It follows that U(L)* is a formal power series algebra. 
More specifically, if we denote the basis element e-^ 1 * • • eA k of U(L) by e a , 
and let {x a } be the dual basis (in the sense of complete topological vector 
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spaces), then U(L)* k[[xi,x 2,...]]. Under this isomorphism 



where x a = * • • x^ k and a! = a M !'*-a tfc !. (Note that we can think of 

a as an infinite sequence of non-negative integers, all but finitely many of 
which are 0. Observe that x® = 1 and 0! = 1.) 

Let II denote an algebra with a spanning set 

{£ a : a a word} 

indexed by all words a = ot\ ■ • -Qi from an alphabet. We describe when 77 
is a shuffle algebra on this spanning set. The shuffle of two words 

a = <*]•• - a,*, /? = /?i • • • Pj 

is defined as follows. Let A' = {1,2, . . . , i + j}, and let 

A : {1,. — AT 
M : { 1 , - - - , J } — + A' 

denote two order-preserving maps such that the images A(a) and p(f3) are 
disjoint and complementary. These data define a word 7 .= ji * • *7^ via 

f if 1 € ImA 

* \ if / e Im//. 

The shuffle of a and /? is defined to be the set of all such 7 obtained in this 
fashion. We can now define the shuffle algebra structure on 77. The shuffle 
product of two elements and is defined by 

£<*■& = 

7er 

where T is the shuffle of the words a and (3 . The algebra 7/ is called a shuffle 
algebra if the multiplication in 77 (with respect to the given spanning set) 
is given by the shuffle product. 

Let II be a primitively generated bialgebra. We define a right and left 
//-module structure on 77* as follows: if p G 77* and h £ 77 , let p h £ 77* 
be defined by 

(p-/i)(A;) =p(hk), ken , 


4 


and let h p E II* be defined by 

( h — h p)(fc) = p(kh), k E //. 

We say that an algebra A is a left H -module algebra if A is a left //-module, 
and 

h-(ab) = J2(h {1) -a)(h {2y b). 

(M 

A right H -module algebra is defined similarly. If A is a left or right H- 
module algebra, we say that II measures A to itself. In particular, II 
measures II* to itself using the actions — * and — defined above. If the 
bialgebra II measures the algebra A to itself, then the elements of P(H) act 
as derivations of A, 

We say that p E II* has finite Lie rank if dim P(H ) — 1 p is finite. Recall 
that p E II* is differentially produced by the algebra R with the augmentation 
€ if 

1. there is right //-module algebra structure on R ; 

2. there exists / E R satisfying p(h ) = e(f ■ h). 

Concrete examples of differentially produced functionals on a primitively 
generated bialgebra (that is, of differentially produced formal power series) 
are given in Section 3. 

Our main theorem is the following. 

Theorem 1.1 Let H be a primitively generated bialgebra over a field of 
characteristic 0. Let p E II* . Then the following are equivalent : 

1. p has finite Lie rank; 

2. p is differentially produced by some augmented k-algebra R for which 
dim(Kere)/(Ker£) 2 is finite; 

3. p is differentially produced by a subalgebra of H* which is isomorphic 
to k[[x\ , . . . ,£/v]], the algebra of formal power series in N variables . 

We prove this theorem in Section 2. We give examples of its application 
in Section 3. 
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2 Proof of Main Theorem 

We first prove that part (1) of Theorem 1.1 implies part (3). Given a fixed 
p E //*, we define three basic objects: 

L = {he P(II)\h-*p = Q) 

J = II L 

J 1 = {q £ II* | q(j) = 0 for all j E J). 

Note that L is a Lie ideal in P(H), so that J is an ideal in the algebra 
H. Also, J is easily shown to be a coideal. Therefore J 1 = ( H/J )* is a 
subalgebra of H*. We will show that J 1 is isomorphic to a formal power 
series algebra, and will construct derivations of this ring which will be used 
to realize the input/output map defined by p. 

Lemma 2.1 If dim P[II)-^p — N , then J x is a subalgebra of H* satisfying 

J 1 = k[[xi ,.. . ,i7v]]- 


Proof . The Lie ideal L has finite codimension N. Choose a basis {ei , e 2 , . . .} 
of P(H) such that {eyv+i , e/v+ 2 > ■ * *} is a basis of L. Note that if e t is the 
image of e t under the quotient map P(H) P(H)/L , then the image of 

{e \ , . . . is a basis for P(II)/L. 

By the Poincare-BirkhofF-Witt Theorem, H has a basis of the form 

{ | *i < - - - < *jt and 0 < a Ir }. 

Since L is a Lie ideal, J = II L is an ideal in the algebra //, and has a basis 
of the form 

g . 1 . K 

with at least one t r > iV. Specifically U(P(H)/L ) = ///J, and 
{ ef 1 ’ ‘ | , . . . , aw > 0 } 


is a basis for U(P(H)/ L). It follows that the elements of the form 


a! 
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with all 1 < x T < N are in J 1 C H* . Indeed, J x consists precisely of 
the completion in the finite topology of the span of such elements. In other 
words, 

j x s fc[[ii,.,.,i w ]], 

completing the proof. I 

We will use the following notation and facts from the proof of Lemma 2.1: 
Suppose that {ei, . . . } is a basis for P(H) such that {eyv+i, . . . } is a basis 
for L. Let {e a } be the corresponding Poincare-Birkhoff-Witt basis. Denote 

J x by R . Then R = k[[x \ , . . . , x/v]], and x* 1 • • * x^ N } ol\ ! ■ • • o/v! equals the 

element of the dual (topological) basis of H* to the Poincare-Birkhoff-Witt 
basis {e a } of //, corresponding to the basis element e° l ■ • • e^fi . 

We now collect some properties of the ring of formal power series R 
which will be necessary for the proof of the theorem. 

Lemma 2.2 Assume p E II* has finite Lie rank, and let R C H* , e a E H , 
and x 01 E R be as above. Define 

/= 6 

a=(ai 

a>0 

where c a = ( ^ . Then 

a a! 

1. H measures R to itself via 

2. p(h) = e(f h) for all h E H. 

Proof. We begin with the proof of part (1). Since II measures H* to itself 
and R C H* , we need show only that R H C R. Take r E R, h E H 
and j E J. We have (r h)(j) = r[hj). Since J is an ideal, hj E •/, so 
r(hj) = 0, so r h E J 1 = R. This proves part (1). 

We now prove part (2). Let e a = e^ 1 be a Poincare-Birkhoff- 

Witt basis element of 77. Since e Q £ J unless C 

p(e a ) = 0 unless {i\, . . . , i^} C {1, . . . , N }. Also e(/ e a ) = / e a (l) = 
/(e^l) = /(e a ) — 0 unless {ii,. . . , C {1,. . . , N}. Now suppose {i l9 . . . , 
ik} C , N}. We have in this case also that p(e Q ) = a!c a = /(e a ) = 

/ — e a (l) = e(f ^e a ). Since {e a } is a basis for 77, this completes the proof 
of part (2) of the lemma. I 

Corollary 2.1 Under the assumptions of Lemma 2.2, f = p. 


Lemmas 2.1 and 2.2 yield that part (1) implies part (3) in Theorem 1.1. 

It is immediate that part (3) implies part (2), 

We now complete the proof of Theorem 1.1 by proving that part (2) 
implies part (1). 

Let x \ , . . . , xn be chosen so that {xi , . . . , x/v } is a basis for (Ker e)/(Ker c) 2 . 
If / G R and h £ //, then 


N 

f ■ h = q 0 (h)l + ^2 Qi( h ) x > + 9(h), 

1 = 1 

where q t G H* and g(h ) G (Kere) 2 . Let l G P{H). Since H measures R to 
itself and A(/) = 10/ + /®1, the map / h / ■ Ms a derivation of R . Now 
let / G R be the element such that 

p(h) = €(f-h). 


Then 


/•« = (/-AW 

N 

= qo (h)l-l + J2^(h)x t -l + g(h)-l. 

:=1 

Since the map /»—►/•/ is a derivation, 1 * l = 0; since p(/i) G (Kere) 2 , 
p(/i) * / G Ker e. It follows that 

/-P(A) = P{hl) 

= €(/'«) 

= £ *(* wa - - o - 

2=1 

Therefore P(iT) p C ^*^1 so p has finite Lie rank. This completes 
the proof of Theorem 1.1 

3 Examples 

In this section, we discuss two examples of applications of Theorem 1.1. The 
first example is obtained by setting the bialgebra H to be the free associative 
algebra over the field k in the symbols E \, . . . , Em . This example motivated 
the theorem and is the basic setting in the control theory literature (see [3], 
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[4] and [15]). The second example is obtained by setting the bialgebra U to 
be families of trees with the appropriate multiplication and comultiplication. 
This example arises when studying algorithms for the symbolic computation 
of higher order derivations generated by derivations E \ , . . . , Em ; see [8] and 
[9]. There is a natural homomorphism between these two Ilopf algebras 
which is described in [8]. 

Example 1. We begin by giving a description of the setting for this exam- 
ple. Let R denote the field of rational functions in the variables xi,.. . 
with coefficients from the field k, and let E \, . . . ,Em denote M derivations 
of R . The algebras in this example are associated with a pair consisting 
of the dynamical system (1) and the observation function (2) introduced in 
Section 1. We assume that the controls 

t * i ^ 

in (1) are continuous and bounded almost everywhere. 

Integrating the initial value problem (1) gives 

M ft 

/(*(«)) = /(*(0)) + £ / dr. 

»=l Jo 


Integrating again gives 


m rt 

/(x(0) = /(x(0)) + £ £„,(/(*(<)))) I 

#*i = l 0 

Af 

+ £ / / ^i( 7 ‘i)^ 2 (r 2 )^ 1 ^ 2 (/(a:(r 2 )))(fr2(fr 1 . 


Continuing this process yields 

M 


ft 

= /(x(0))+£ j u^{r)dr x E^{f{x 

Ml = l J ° 


( 0 ))) 


+ . . . + E, k - • • (/(x(0))) 


vt f l r k -' 

}_ , / ■•■/ u lii (r i )---u (Xk (r k )dT k ---dri 

,..«=! J ° J ° 


+ remainder, 


9 



where the remainder is of the form 


• E Hk +i • • • E m (f( x ( T k+ 1 ))) dr k+1 ■ ■ ■ d.T\ . 

Let fi = pi * • - Hk denote a word of length k built from the alphabet {1, 
. . . , M}. The process above defines a formal series 




p ~ 

words n 

(3) 

where 


c, t = £„*•■• E m f(x( 0)) e k, 

(4) 

and 


r r-t 



4.(0 = < 

/ u n\{ T ) dT if A* = 

r 

/ Um( T )Zm-» k ( T )dT if n = fii...n k . 
< Jo 

(5) 


It is a theorem of Chen [1] that functions of the form (5) form a shuffle 
algebra, that is, that 

&(0 •&(*) = £ 6 ( 0 . 

v 

where the sum is over words v that are in the shuffle of A and fi. 

Let H = k<E \ , . . . , E\i> denotes the free associative algebra in the 
symbols , . . , , Em over the field k. Recall that H is a bialgebra. The 
coproduct and counit are defined by letting 

A (Ei) = l®E t + E t ® 1, 

<(E t ) = 0, 

for i = 1,..., Af, and then extending to all of k<E \ , . . . , Em > by requiring 
that A and e be algebra homomorphisms. The bialgebra H is cocommu- 
tative, but not commutative. The algebra of formal series in the £p(t) is a 
quotient of the algebra II * . 

The papers of Fliess [3], [4], Reutenauer [15], and Crouch and Lamnabhi- 
Lagarrigue [2] all view the formal series p above as an element of the shuffle 
algebra of formal power series in the noncommuting variables E \ , . . . , Em . It 
is easy to relate that point of view to the point of view taken here. The bial- 
gebra H has basis consisting of all words E ^ in the generators E \ , . . . , Em, 
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including the empty word 1. Let denote the elements in the dual H* of 
II which are formally dual to the E that is, 

U^) ~ 

where 6^ fU is the Ivronecker delta. Then the can be viewed as a topological 
basis for the formal non-commutative power series ring over k generated by 
E\, . . . , Em . As we observed in Section 1, the bialgebra H * is a commutative 
algebra with respect to the shuffle product on the Fixing a control 
system (1) and an observation function (2) determines an element of H* 

P = 

words m 

where the c M are given by Equation (4). The element p given by Equation (3) 
can be viewed as an element of a quotient algebra of H * . Theorem 1.1 
applied to this example gives the classical theorem of Fliess [3], [4]. 

Example 2* We follow [8] and [9] for this example. By a tree we mean a 
rooted finite tree [18]. If {Ei, . . . , Em} is a set of symbols, we will say a 
tree is labeled with { E \ , . . . , Em} if every node of the tree other than the 
root has an element of { E \ , Em} assigned to it. We denote the set of 
all trees labeled with {Ei, ..., Em} by £T(Ei, Em )• Let k{CT(E\, 

. . . , Em)} denote the vector space over k with basis £T(Ei, . . . , Em). We 
show that this vector space is a graded connected Hopf algebra. 

We define the multiplication in k{CT(E \ , Em)} as follows. Since 
the set of labeled trees form a basis for k{CT{E\ , . . . , Em)}, it is sufficient 
to describe the product of two labeled trees. Suppose t\ and t<t are two 
labeled trees. Let s\, . . . , s r be the children of the root of t\. If <2 has n + 1 
nodes (counting the root), there are (n -f l) r ways to attach the r subtrees 
of Zi which have s\, . . . , s r as roots to the labeled tree £2 by making each 
the child of some node of ^ 2 , keeping the original labels. The product t\t 2 is 
defined to be the sum of these (n + l) r labeled trees. It can be shown that 
this product is associative, and that the tree consisting only of the root is a 
multiplicative identity (see [5] or [6] for details). 

We define the comultiplication A on k{CT(E\, . . . , Em)} as follows. Let 
t be a labeled tree, and let S \ , . . . , s r be the children of the root of t. If P is a 
subset of C t = {si , . . . , s r }, let tp be the labeled tree formed by making the 
elements of P the children of a new root, keeping the original labels. Define 
A(tf) = Y^PCCt ® tc t \Pi w here A”\y denotes the set-theoretic relative 


11 



complement of Y in X . Define the augmentation c(t) of the bialgebra to be 
1 if t has only one node (its root), and 0 otherwise. We define a grading on 
k{CT{E\, . Em)} by letting k{CT(E\ y . Em)}u be the subspace of 
k{CT{E \ , . . . , Em)} spanned by the trees with n + 1 nodes. The following 
theorems are proved in [6]. 

Theorem 3.1 II = k{CT(E\, . Em)} is a cocommutative graded con- 
nected bialgebra . 


Theorem 3.2 The set of labeled trees t whose root has exactly one child is 
a basis for the primitives P(II) of H = k{CT{E\ , ... } Em)}- 


Let R denote the field of rational functions in the variables X \ , 
with coefficients from the field /c, and let E \, . . . , Em denote M derivations 
of R of the form 


N 


= yif— 


where 6^ E R. We now define an i7-module algebra on R . The action of II 
on R is given by the map ip : II — ► End*. R, which is defined as follows. 


1. Given a labeled tree t with m + 1 nodes, assign the root the number 
0 and assign the remaining nodes the numbers 1, . . . , m. We identify 
the node with the number assigned to it. To the node k asociate the 
summation index pi<. Denote (pi , . . . , p m ) by p. 

2. For the labeled tree /, let k be a node of £, labeled with E lk if k ^ 0, 
and let /, . . . , /' be the children of k . Define 


c(k;p) = 


Ox 


d 




d 

— if k ^ 0 is not the root; 


d 


Note that if k ^ 0, then c(k;p) E R- 


if k — 0 is the root. 


3. Define 


N 


V>(<) = E l;/z)c(0;/i). 

VI ,...,Vm = 1 


4. Extend ip to all of II by linearity. 
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It is straight-forward to check that this action of H on R makes R into a 
H -module algebra. 

An element p £ H m can be thought of as an infinite series whose terms 
are indexed by labeled trees rather than by words, as well as an element of a 
power series algebra. Theorem 1.1 gives necessary and sufficient conditions 
for p to be differentially produced in this case. 
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